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Th«  U««cb«r  !!•••«§•  Swltchlnf  C«ne«r  ftaplMMMnC  (UKSCft)  T*st  and  Bv«luaclon  Hastcr 
Pl«n  (TEMP)  eucliiM*  ch*  T««c  «fid  Cvaltuicion  (T4I)  procaaa  chac  will  b«  uaad  co 
•n«ur«  aliwt  cha  UNSCll  aaaca  tha  ra^lraaanta  of  both  tha  projacc  apaclflcacion  and 
eha  ra^lraaanca  alleaatad  froa  cIm  Kaclonal  lUrtpaca  Syataa  (HAS)  dociaaanca.  Ic 
provldas  stratagy  and  guldanea  for  cast  ra^ulraaMmca .  Iba  IMSCt  TEMP  has  boon 
praparsd  in  accordanca  with  PAA  Ordar  1110.41  and  PAA*sn)>024a.  Tha  UKSCt  TEMP 
follows  cha  ra<|ulrMoncs  daflnad  In  PAA*E*2744€.  WOO  laqulrssMncs  Spaclflcaclon. 

This  TEMP  is  a  hlfh'lsval  decwaanc  chat  ralacad  raqulrad  syscaa  characcarlscics  and 
erictcal  issuas  to  case  objaeclvas.  Ic  addrassas  Davalopaancal  Tasc  and  Bvaluaclon 
(0T4C).  Producclon  Accapcanca  T4C  (PAT&C).  Oparaclonal  TIE  (OTIE)  for  NAS 
Incagracion  (OTAC  Incagracion  and  OTAE  Oparaclonal).  and  OTAE  for  Syscasi  Shakadown 
(OTAE  Shakadown).  Tha  TEMP  also  oucltnas  procaduras  Co  ba  followad  co  ansura  cha 
suecassful  incagracion  of  cha  UHSCk  syscan  into  cha  HAS.  Tastlnc  is  parfontad  Co 
ansura  incagracion  of  now  subsysc^w  will  not  dagrada  cha  curranc  oparaclona  of  cha 
NAS 


This  TEMP  raiacas  cha  TAS  afforcs  co  cachnical  risks,  oparaclonal  Issuas  and 
conespes.  syscaa  parforaanca.  raliablllcy.  awallabllicy .  ■alncalnablllcy,  logistics 
ra<)uirwBanes .  and  schadulas.  Tha  TAE  co  ba  parforaad  co  vorlfy  solcwaro/hardwara 
coaponancs  and  aysCM/HAS  lawal  oparaclona  of  cha  IMSCt  syscaa  la  addrassad  in  Uiis 
TEMP. 
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EXECOnVE  SUHHARY 


Th«  W««ch«r  Switching  Center  Eepleceaent  (UHSCl)  Test  end  Eveluetlon  Meeter 

Plan  (TEMP)  outline#  the  Test  end  Eveluetlon  (TliE)  procese  thet  will  be  ueed  to 
eneure  the  UlSCE  neete  the  requireaente  of  both  the  project  specificetion  and  the 
requirenente  allocated  froai  the  ietlonal  Aircpece  Spetea  (MAS)  docuaenta.  It 
provide#  strategy  and  guidance  for  teat  requireaenta. 

The  UMSCE  TEMP  haa  been  prepared  in  accordance  with  FAA  Order  18X0.41  and 
PAA-STD-024a.  The  MMSCI  TEMP  follow#  the  requlreawnta  defined  in  FAA-E-2764c, 

UMSCE  Eequireaenta  Specification. 

Thia  TEMP  la  a  high-level  docuaent  that  relate#  required  ayatea  characteriatica  and 
critical  iaauea  to  teat  objective#.  It  addreaaea  Developaental  Teat  and  Evaluation 
(OTEE),  Production  Acceptance  TEE  (PATEE),  Operatimial  (OTEE)  for  MAS 
Integration  (OTEE  Integration  and  OTEE  Operational),  and  OTEE  for  Spataa  Shakedown 
(OTEE  Shakedown) . 

Thia  TEMP  outline#  procedure#  to  be  followed  to  enaure  the  aucceaaful  integration 
of  the  UMSCE  ayatea  into  the  MAS.  Teating  la  perforaed  to  enaure  the  integration 
of  the  new  aubapatea  will  not  degrade  the  current  operation#  of  the  MAS. 

Thia  TEMP  relate#  the  TEE  effort#  to  technical  riaka,  operational  iaauea  and 
concept#,  apatea  perforaance,  reliabilitp,  availabilitp,  aalntainabilltp,  logiatle 
requireaenta,  and  achedulea.  The  TEE  to  be  perforaed  to  verifp  aof tware/hardware 
coaqponenta  and  apatea/MAS  level  operation#  of  the  UMSCE  apatea  ia  addreaaed  in  thia 
TEMP. 
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L  roiFQSE. 


This  docusksnt  is  ch*  Test  and  Evaluation  Mastar  Plan  (TEMP)  for  tha  Waathar  Massaga 
Switching  Cantar  laplacasMsnt  (WtSCt)  subsfstaa  of  tha  Rational  Airspace  Systae 
(HAS)  as  defined  in  PAA-E'27S4c.  This  TEMP  has  bean  prepared  in  accordance  with 
PAA  Order  1810. 4B  and  rAA-STD<024a. 

This  TEMP  is  a  high-level  document  that  relates  required  systaw  characteristics  and 
critical  issues  to  test  objectives.  It  addresses  Developmental  Test  and  Evaluation 
(DTltE),  Productira  Acceptance  T4E  (PAT&E),  Operational  TfcE  (OT&E)  for  HAS 
Integration  (OT&E  Integration  and  OTfiE  Operational)  and  0T4E  for  System  Shakedown 
(OTkE  Shakedown). 

This  TEMP  outlines  the  TIE  process  that  %«ill  be  used  to  ensure  the  MtSCE  meets  the 
requirements  of  both  the  project  specification  and  the  requirements  allocated  from 
the  HAS  dociasents.  It  also  provides  strategy  and  guidance  for  test  requirements. 

The  level  of  detail  contained  in  this  TEMP  is  only  to  the  extent  necessary  to 
support  the  development  of  high  level  schedules  for  planned  tests.  This  TEMP 
relates  the  T&E  efforts  to  technical  risks,  operational  issues  and  concepts,  system 
performance,  reliability,  availability,  maintainability,  logistic  requirements,  and 
schedules . 

The  TEE  to  be  performed  to  verify  software/hardwere  eompooents  and  aystem/MAS  level 
operations  of  the  IRISCB  system  is  addressed  In  this  TEMP. 
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The  following  specifications,  standards,  and  other  documents  were  used  In  the 
development  of  this  TEMP  and  are  referenced  herein. 


1.1  iAA  aflCIflCAIlQIia. 

a.  rAA-E-27«4c 

b.  rAA-E-2770b 


a.  PAA  Order  7032.) 


b.  PAA  Order  ItlO.At 


Weather  Heasage  Pitching  Center 
Eeplecsment  System  Specification 

RAOIH  Packet  Switch  Hecwork  (PSH) 
Punctional  Specification 


Air  Traffic  Service  Operational 
Requirements  for  the  WMSCR, 

Hovember  ISS) 

PAA  HAS  Test  and  Evaluation  Program 
October  22,  1992 
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2.3  fAA  SIAmUfS- 


m. 

FAA-ST0'024a 

PraparaClon  of  Tasc  and  Evaluation 
Oocuaantaclon.  August  1987 

OTHEK 

FAA  DQCUMPfTS. 

•. 

U.S.  Oapartaant  of  Transportation,  Fedaral 
Aviation  Adtoinistrstion,  Aviation  Systaa 
Capital  laprovaaont  Plan.  Daco^ar  1991 

b. 

HAS < St- 1000 

HAS  Syataai  ta^iraaants  Spacification  with 
Spaeifieatlon  Chang*  Hoticas  (SCM)  1  throu^ 
10.  Hovaabar  27,  1991 

c . 

NAS-SSIOOO 

HAS  Systaa  Spacification  with  SCMs  1  through 
14,  May  1992 

4 

NAS-It-2)0«2S07b 

IMSCl/AOAS  ItD.  August  19.  1984 

• . 

|{ASIt-2S042S07 

IMSCt/AtfP  ItD.  February  19.  1987 

f. 

HAS- It- 25072505* 

VMSCl/C3iSP  ItD.  Fabruary  29,  1991 

1 

HAS- It -92020000c 

VHSCt/Codad  Tlaa  Saurea  (CTS)  Users  ItD. 

July  30.  1991 

h. 

HAS -It -5 1030002b 

Naintananc*  Procaasar  Systaa  to  Autoaation 
S«ibsyscaas  ItD.  January  15.  1992 

t 

HAS-lt-94012507a 

IMSCtyNassags  Switch  Hatwark  Users  ItD. 
February  20.  1991 

J 

HAS- It -430200010 

RADIHA-25  Packat  Node  Users  ItD. 

March  5.  1992 

k. 

HAS- It -90022507a 

IMSOt/IRfSTC  (AlphaauaarU)  ItD.  Part  I. 
February  1.  1991 

1 

RAS-It-90022507 

UKSOl/IMSTC  (Graphic)  ItD.  Part  II. 

February  27.  1987 

•  . 

HAS -It- 94022507b 

IMSCt/Peckac  Hetwark  Users'  UD. 

Fsbruary  20.  1992 

n. 

HAS- It -250725116 

IMSCt/IVF  IlD.  February  20.  1991 

o 

HAS- It- 25072513b 

UNSat/DLF  ItO.  February  20.  1991 

P 

HAS-tt-94032507a 

UKSet/Asynchroneus  PAD  Users  ItD, 

February  20,  1991 

HAS- It -25072401a 

UNSet/TMP  ItD.  February  20.  1991 
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2.?  HISCELUWEWS- 

«.  ATC-90'001  NAS  Project  Neecor  Schedule  Baseline 

Report  (Published  Monthly) 

b.  MADIN  Packet  Switch  Network  Master  Test 

Plan.  Septeaber  8.  1991 


3.  PEsainioB 


3.1  Hiasiofi 

The  UMSCK  systea  will  replace  the  current  Weather  Message  Switching  Center  (UMSC) 
with  up-to-date  equlpaent  and  perfora  all  current  weather  data  handling  functions 
of  the  UMSC  and  Notice  to  Alraen  (NOTAM)  distribution.  It  will  rely  on  the 
National  Airspace  Data  Interchange  Network  (NADIN)  PSN  for  coaaunl cat Ions  support 
to  distribute  both  alphanuaerlc  and  graphic  weather  pro^jicts. 

The  UMSCB  syscea  consists  of  two  identical  nodes  located  at  the  Netlonal  Aviation 
Weather  Processing  Facility  (HAUPF)  sites  In  Salt  Lake  City,  Utah,  and  In  Atlanta. 
Georgia.  Each  node  will  service  approalMtely  one-half  of  the  NAS.  High 
operational  availability  will  be  echieved  by  ellowing  either  node  to  assuae 
cooqplete  systea  operation  should  one  node  fall.  No  perceptible  decrease  In  user 
service  levels  will  be  eaperlanced  under  single  node  operation. 

3.2  naiiM  imBAiy 

).2-l  JCsY  Functions 

The  UM3C1  systea  coaprlses  five  aejor  functional  areas. 

3-2,1. 1 _ (IflMyntffBtimi 

The  ccaa>mlcecions  function  will  provide  for  the  acquisition  and  dlssealnatlon  of 
weather  and  (K/TAM  Inforaacton  over  the  Interfacing  cooBunicetions  network  and 
dedicated  circuits 

3>2^iJ _ fmuaifli 

The  processing  function  will  identify,  validate,  and  asseable/disasseable  products 
and  reports. 

3. 2,1.3..  atarau  and  temaTii 

The  storage  end  retrieval  function  will  access  WKSCl  data  bases  via  a  data  storage 
elenont.  a  data  retrievel  elenent.  and  a  data  deletion  elaBont. 
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Th«  control  fvincclon  will  consist  of  the  IntemsI  nonitorlng  and  reconfiguration 
elaswnts  that  will  parfom  autosuitlc  systaa  control  and  perait  operator  initiated 
systea  control  actions. 

PfvtlgBitnv  ttw>  Tttting- 

The  developaent  and  testing  function  will  support  systea  develoi»ent  and  testing, 
hardware  and  software  aodifieation,  and  systea  enhancements.  It  will  consist  of  a 
software  developaent  and  test  capability  and  a  coamunications  network  simulator. 

_ System  Interfaces. 

The  WMSCR  system  will  interface  with  weather  and  NOTAM  data  suppliers  and  users  via 
dedicated/direct  and  HAOIN  PSN  coamunications  links. 

_ Pt4U*a^/Plmt  VMft 

The  VAtSGl  node  will  have  dedicated  coaaamlcations  links  with; 

a.  The  other  VAtSCR  node, 

b.  The  collocated  Aviation  Uaathar  Processor  (AW?)  (see  section  2.4.e.). 

c.  The  Consolidated  NOTAM  Systea  Processor  ((3ISP)  (see  section  2.4.f). 

NOTE:  The  CMSP  has  never  been  defined  as  a  formal  NAS  program.  All  tests  for  the 
CNSP  have  been  deferred.  The  Consolidated  NOTAM  System  ((3IS)  will  be  relocated  and 
an  X.25  Interface  developed  for  the  PSN.  The  relocated  CNS  will  be  tested  to  1MS(31 
via  the  PSN  by  Engineering.  Integration,  and  Operational  Evaluation  Service  (ACU) 
and  Air  Traffic  Operational  Support  Service  (AOS).  See  paragraph  3. 2. 2. 2.1. 

3.2. 2. 2  NADIN  PSN  Users 

Each  UHSCR  node  will  support  the  following  users  via  the  NADIN  PSN  (see  section 

2.4. J): 


a.  The  National  Weather  Service  Telecommunications  Cutaway  (NWSTC)  (see 
sec e ions  2  4 . k  and  2.41). 

b  The  Meteorologist  Weather  Processor  (NWP  II)  and  Central  Flow  MW?  (CniVP) 
(see  section  2 .4.a) . 

c  Real-tlae  Weather  Processors  (XWPs)  (see  section  2.4.n). 

d  Automated  Weather  Observation  Systea  (AWOS)  Data  Ac^lsitlon  Systea 
(ADAS)  (see  section  2.4.d). 

e  Leased  Service  A  SystOM  (see  section  2. 4. a). 


f.  Asynchronous  PAD  (APAD)  users  (see  section  2.4.p). 


g.  Th«  U.S.  Dep«rtiMnt  of  Defense  (DOD)  vie  Tinker  Air  Force  Base  (KAUN) 

(see  section  2. 4. a), 

h.  The  Necional  Severe  Storas  Forecast  Center  (NSSFC)  (see  section  2. 4. a), 

i.  The  NAOIN  Message  Switch  Network  (MSN)  Subscribers  (see  section  2.4.i), 

j .  Data  Link  Processor  (DLP)  foraerly  the  Weather  Coamunications  Processor 
(UCP)  (see  section  2.4.o), 

k.  Maintenance  Processor  Subsystea  (MPS)  (see  section  2.4.h), 

l.  Traffic  Manageaent  Processor  (TMP)  (see  section  2.4.q) 

a.  Consolidated  NOTAM  Systea  (CNS)  Interface  will  be  tested  to  UMSCR  via 
the  PSN. 

J _ C94«d  TtM  Sowret- 

Each  UMSCR  node  will  be  capable  of  receiving  a  serial  coded  tiae  data  streaa  froa 
the  Coded  Tiae  Source  (see  section  2.4.g)  in  the  collocated  AUP.  Each  node  will 
periodically  saaple  this  tisM  data  and  synchronize  the  internal  nodal  systea  clock. 

_ tfniawt  SYitta 

_ SlntU  Sygcf 

One  UMSCR  systea  consisting  of  two  nodes  will  be  developed  and  produced.  The  UMSCR 
will  be  Installed  and  tested  as  a  total  systea  at  the  operational  sites. 

_ Full  gRtritidM 

The  UMSCR  systea  will  operate  24  hours  a  day.  7  days  per  week  with  each  node 
responsible  for  serving  approxlaately  half  of  the  NAS. 

_ SImU  t)dl  Btnrurt 

cither  UMSCR  node  will  be  capable  of  asstalng  full  network  op  rations  If  the  other 
node  falls.  The  systea  will  aonlcor  the  status  of  all  systea  eleaents,  and 
autoaatlcally  subscltuce  redundant  eleaents  or  switch  to  a  backup  aode  of 
operation. 

3 .2.1.4  Status  Inforaaclon  Eachanaa. 

The  key  elesMnt  of  the  overall  control  strategy  is  the  exchange  of  status 
Inforaetlon  between  the  nodes.  This  intamodal  coordination  provides  for  the 
transfer  of  systea  tasks  to  the  opposing  node  If  either  node  is  in  the  failure  or 
nodal  recovery  state. 

3  3  RIOUIRRD  QPtRATlQHAL  CHARACTERISTICS 

The  following  fvmctlons  have  been  defined  as  the  Air  Traffic  Service  IMSCR 
operational  requireaents  in  FAA  Order  7032.3  (see  section  2. 2. a): 
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lAA _ Message  Processing. 

The  message  processing  fvinction  will  consist  of: 

a.  Message  Identification  and  breakdown  by  t3rpe  and/or  origin, 

b.  Message  error  detection  and  correction, 

c.  Message  storage  using  append/replace  techniques,  purge/retain  by  time 
of  receipt  and  on-line  retention  based  on  report  type, 

d.  Message  routing  based  on  established  time  Intervals  and/or  priority  In 
appropriate  formats, 

e.  Message  code  and  format  conversion  as  required  for  Internal  storage 
compatibility  and  Interface  requirements, 

f.  Input/output  message  accountability, 

g.  Message  journalizing, 

h.  Message  priority  for  collection  and  distribution, 

1.  Validation  of  various  message  fields  for  report  type  designator  and 
date/time  groups, 

3-3.2 _ Requeat/Replv. 

The  request/reply  service  provided  will  give  end  users  the  ability  to  request  and 
receive  weather  products  not  normally  received.  The  WMSCR  will  have  the  ability  to 
validate  request/reply  access. 

3.3.3  _ Statistical  Collection  and  Processing. 

Statiscical  coli.ection  and  processing  will  provide  statistical  Information  on 
system/network  performance  Including  an  analysis  of  Individual  product  activity  and 
identification  of  Inactive  products  or  data. 

3.3.4  _ Diagnostic  Checks. 

Diagnostic  checks  will  generate  operator  notification  for  failure  detection  and 
reconfiguration . 

3.3.5  _ Supervisory  Functions. 

System  supervisory  functions  will  provide  the  capability  for  on-line  modification 
of  system  collectlon/distrlbutlon  tables. 

3.3.6  _ Weather  Data  Editing. 

A  weather  data  editing  capability  for  messages  received  In  error  that  are  not 
returned  to  the  sender  for  correction  will  be  provided. 


6 


rhe  Intercept  function  will  provide  the  capability  to  initiate  aessage 
interceptions  (off-line  storage)  for  users  to  maintain  accountability  In  the 
event  of  message  transmission  backlogs. 

_ System  Reconfiguration. 

nie  system  reconfiguration  will  provide  both  fail-safe  and  fall-soft  character¬ 
istics.  Fail-safe  will  be  when  a  unit  or  element  autoutically  takes  over  for  a 
failed  component  without  degrading  system  operation.  Fail-soft  will  be  idten  no 
backup  element  or  unit  is  available,  but  the  system  operates  in  a  degraded  mode. 

In  the  event  of  a  complete  system  startup,  database  restoration  capabilities  will 
be  provided. 

2  -3.^ _ Syitta  fcaanilgn- 

A  100-percent  system  expansion  capability  will  be  provided  in  the  initial 
hardware/software  configuration  without  any  changes  in  the  design  characteristics. 

3.4  REQUIRED  TECHNICAL  CaiARACTERISTICS . 

The  following  are  the  Mjor  technical  and  performance  requiresMnts  for  the  WMSCR 
system  as  identified  in  the  UMSGl  System  Specification  (see  section  2.1. a).  The 
numbers  in  parentheses  provide  ready  reference  to  the  applicable  paragraph  in  that 
document . 

Reliability,  maintainability,  and  availability  (RHA)  requirements  were  verified  by 
analysis  during  system  development  and  test.  All  other  technical  requirements  were 
verified  during  or  prior  to  the  Factory  Acceptance  Test  (FAT). 

Uul _ Itchnlcii  RaftuiiMwnM 

a.  Reliability  (3.4.1) 

Hean-Tlme  Between  Failures  (KTBF)  >  1666  hours* 

b.  Maintainability  (3.4.2) 

1.  Mean -Time -To -Repair  (MTTR)  0.1  hours’ 

2.  85  percent  of  failures  isolated  to  one  LRU’ 

3.  95  percent  of  failures  isolated  to  two  LRU  (maximum) 


*ror  crittol  aquipMat  (CS)  enly.  CX  coMlata  of  Um  eantral  procMilat  unit,  tha  eaaaialcatlaiu 
aqulpeant  aapportlns  Um  tynehMaeva  Intarfacaa  Vo  U>a  SADIS  FSS.  SWtD.  U>a  ptiaary  and  aacondary  atoraga 
daaieaa,  and  tha  intaataca  avpportlns  at  laaat  ana  oparatar  poaltton. 

’Saa  pravioua  footaeta. 

’toaiaat  lapaiiabla/SaplacaaSIa  Onit. 
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c.  Inherent  Availability  (Al)  (3.4.3) 

d.  Product  Inforaatlon  Databaae 

(3. 1.4. 2. 1.2) 

a.  On-llna  Evant  Log 
(3. 1.4. 4. 1.4. 6) 

f.  Data  Storage  Capacity 
(3. 1.4. 1.2. 9) 

g.  Oparata  with  no  air  conditioning 
(3. 1.4. 4. 1.3. 1.3.) 

h.  Survive  power  Interruptlona 
(with  no  loae  of  volatile  naaory) 
(3. 1.4. 4. 1.3. 1.3.) 

1.  Reconfigure  for  failed  hardware 
(subscriber  outage) 

(3. 1.4. 4. 1.3. 1.2) 


0.9997* 

■InlauB  20,000  entries 

■InlauB  24  hours 

6  hours/interface 
(alnlmsa)  20  alnutes 
(■axlaua)  2.0  alnutas 

(■axlaua)  10  seconds 
(■axlaus)  10  seconds 


2.^.2  ftrf gnanfii  Etwirmnti  • 


Mean 

9Sth  percent 

(In 

1 

o 

u 

e 

m 

a.  Data  Identification,  Validation, 

and  Distribution 

15.0 

30.0 

b.  Data  Requests  and  Urgent  Products 

1.0 

3.0 

c.  Product  Asseably 

30.0 

60.0 

Mean 

95th  percent 

(In 

seconds) 

a.  Product  and  Report  Storage 

10.0 

20.0 

b.  Proihict  Retrieval 

A 

B 

%>hare:  A  -  2.5  ♦  0.002*  (product  sixe  In  bytes)  and, 
B  -  15.0  *  0.005*  (product  slse  In  bytes) 


*XMliMt««  •(  CS  m4  r«eM«X  *vi«it«i  SSMalatcatlMi  (FM)  pcvaldM  ait  eMditloBlec  and  poMt. 
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c . 

Report  Retrieval 

C 

0 

where:  C  -  5.0  +  0.002*  (product 

size  in  bytes)  and, 

D  ••  20.0  +  0.005*  (product  size  in  bytes) 

d. 

Weather  Date  Deletion 

Maxiaua 

5  Minutes 

(after  purge  tiae) 

• . 

NOTAM  Data  Deletion 

Maxiaua 

30  seconds 

(after  receipt  of  file  froa  CNSP) 

3. 4. 2. 3, 

Intgrriodal  Coordination  1.  4  4  3 

Input  Data  Coordination 

Maxiaua 

30  seconds 

(after  identification  of  incoaing  product) 

b. 

Output  of  Data  Coordination 

Maxiaua 

30  seconds 

(after  coaq>letion  of  product  transaission) 

c . 

Database  Coordination 

Maxiaua 

10  seconds 

(after  change  co^>leted  at  one  node) 

3. 4. 2.4 

Ooerator  Coanand  Functions  (3. 1.4.4 

.3.3)*. 

Mean 

95th  percent 

(in  seconds) 

«. 

Status  display  coaaumds 

1.0 

3.0 

b. 

Display  product  or  report 

1.0 

3.0 

c . 

Activate/deactivate  log  printer 

1.0 

3.0 

d. 

Audible  alara  response 

1.0 

3.0 

«. 

Scan  for  further  errors/ 
terainate  editing 

1.0 

3.0 

f, 

Delete  10  eleaents  froa  Coaa 

Data  Storage 

2.5 

5.0 

8 

Initiate  editing/ 

return  product  for  distribution 

3.0 

5.0 

h 

Start  off* line  foraal  transfer 

3.0 

5.0 

1 

Display  event  log 

3.0 

5.0 

es«t«tiau  mi  tlw  Frodiiet  latecM 

tioa  OaMbaaa  (PX08),  Station  IdaottfieatlMi  Databaaa 

(SlBl)  Mid 

dTAMkle  databMM,  aacS  eparatot  eeMaaad  la  aLieaad 

Ml  addltlMMl  2. 

S  aaeonda  tor  aaeh  1,000  antrlaa  in  tha 

not  or  S1I». 
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J- 

Databaaa  Elamant  Updataa 

3.0 

5.0 

k. 

Ratriaval  from  Data  Storaga 

3.0 

5.0 

1. 

Circuit  /  Altamata 
Actlvata/Daactivata 

3.0 

5.0 

m. 

Dalata  a  product  or  raport 

3.0 

5.0 

n. 

Circuit  raconflguration 

5.0 

10.0 

o. 

Modify  collactlva  breakdown 

5.0 

10.0 

P* 

Modify  data  ratriaval  adaptation 

databaaa 

5.0 

10.0 

Tg$T  AHP  gyALVATIgW  ISSBB?- 

Th«  following  ar*  tha  critical  tachnleal  and  oparatlonal  laauaa  to  ba  raaolvad 
during  tha  VBISCR  taat  and  avaluatlon  procaas. 

_ Tachnleal  laauaa. 

Tha  following  paragrapha  dlacuaa  tha  critical  tachnleal  laauaa  aaaoclatad  with  tha 
davalopnant  and  implasantation  of  tha  HMSCR  ayatan. 

a.  Syataa  Parfozmanca  Undar  Load.  Tha  UMSCR  auat  (Mat  tha  following 
tachnleal  parformanea  raqulrananta  undar  tha  traffic  loada  Idantifiad  in 
appandlx  11  of  tha  FAA-E>2764c,  WfSCR  Syataa  Spaci float ion: 

1.  Data  ratriaval  par  paragraph  3. 1.4. 3. 6. 3  of  FAA-E-2764c  In  tha  dual 
and  alngla  noda  eonflguratlona  undar  tha  "paak  plus  oargln"  traffic  load. 

2.  Procaasing  parfomanca  par  paragraph  3. 1.4. 2. 6  of  FAA>E-2764c  in  tha 
dual  and  alngla  noda  eonflguratlona  undar  tha  "paak  plua  margin"  traffic  load. 

3.  Oparator  command  raaponaa  timaa  par  paragraph  3. 1.4. 4. 3. 3  of 
FAA-E-2764C  In  tha  dual  and  alngla  noda  eonflguratlona  undar  tha  "paak"  and  "paak 
plua  margin"  traffic  loada. 

b.  Data  Format  Procaaalng.  Dua  to  tha  avolvlng  and  nonatandard  uaa  of  tha 
varioua  data  formata,  tha  VHSCE  muat  ba  capabla  of  procaaalng  all  tha  varloua  data 
formata  that  will  axlat  at  tha  tlma  of  daploymant. 

c.  HADIR  P8H  Availability.  Tha  availability  of  tha  HADIH  PSH  la  conaidarad 
a  critical  tachnleal  laaua  In  that  tha  HMSCR  intarfaca  to  tha  PSH  muat  ba  taatad 
and  approvad  prior  to  taatlng  tha  communicationa  with  tha  waathar  data  and-uaara 
via  tha  PSH. 

3.5.2  Oparatlonal  laaifa. 

Tha  critical  oparatlonal  laauaa  to  ba  raaolvad  concam  conformanca  taatlng  for  tha 
WHSCR  and  uaar  ayatama  on  tha  HADIR  PSR. 
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3,5,2a  WHSCR/PSH  Conforwanc*. 

PSN  conformanc*  1«  critical  In  that  NMSCR  coonunlcatlons  with  most  end-usars  will 
ba  connactad  via  tha  NADIN  PSN.  Thosa  usars  that  ara  to  connact  to  tha  PSN  must  ba 
subjactad  to  and  pass  tha  NADIN  PSN  conformanca  tast.  Dalays  In  tha  PSN  may  rasult 
In  significant  dalays  In  NHSCR  OT&E  and  daploymant.  Without  tha  PSN,  tha  WMSCR 
systam  can  only  support  tha  AWPs,  Without  tha  PSN,  WMSCR  cannot  complata  tha 
raqulrad  OTAE,  and  consaquantly  cannot  bacoma  oparatlonal, 

_ Msay 

Usar  availability  is  critical  in  that  aach  typa  of  usar  must  ba  raprasantad  during 
OT&E,  Tabla  3. 5. 2. 2-1  shows  all  tha  WMSCR  systam  intarfacas  groupad  by  tha 
communications  path  to  tha  WMSCR,  thalr  tantatlva  Oparatlonal  Raadinass  "  -:e  (ORD) 
and  thalr  availability  for  OT&E  basad  on  tha  cooiplatlon  of  WMSCR  Slta  /  lanca 
Tast  (SAT)  in  April  1992. 

3, 5. 2. 3  Usar /PSN  Conformanca. 

All  PSN  usars  must  also  pass  tha  NADIN  PSN  conformanca  tast  prior  to  baing  allowad 
to  connact  to  tha  PSN.  Whila  tha  PSN  projact  will  provida  tha  conformanca  tast 
tool,  tha  managamant  and  tachnlcal  aspacts  of  tha  conformanca  tasting  hava  yet  to 
ba  Idantlfiad. 

_ Simulated  versus  On-lina  Inputs. 

As  raflactad  in  tabla  3. 5. 2. 2-1,  not  all  WMSCR  systam  Intarfacas  will  ba  available 
for  tasting.  Each  WMSCR  node  contains  a  built-in  simulation  function  that  will  be 
used  to  tast  tha  systam  interfaces  to  basallnad  IRD  requiramants .  Specific 
raqulremants  for  tha  use  of  tha  WMSCR  simulation  function  will  be  defined  in  the 
plans  for  OT&E. 


3. 5. 2. 5  Test  Databases /Sets.  Tast  databases  and  test  data  sets  were  to  be 
developed  and  updated  to  ensure  that  they  provida  complata  WMSCR  tasting  scenarios, 
aspacially  in  regard  to  massage  types  and  frequency  of  arrivals.  Requirements  for 
tast  databases  and  tast  data  sets  development  and  maintenance  ware  reflected  in  the 
plans  for  contractor  tasting  and  ara  being  developed  for  OT&E. 


11 


TABLE  3. 5. 2. 2-1. 


UMSCR  INTERFACE  SYSTEM  AVAILABILITIES 


CoaM 

Systea 

1st  ORD 

Ust  (»ID 

OT&E 

Path 

Availability 

Direct 

AVP 

N/A 

N/A 

Available 

CTS 

N/A 

N/A 

Available 

NADIN  PSN  ORD 

N/A 

Oct  94 

Available 

CNSP 

N/A 

N/A 

Deferred 

NAOIN 

Airlines (X. 25) 

Unknown 

Unknown 

Unknown 

Direct 

NUSTG 

N/A 

N/A 

Available 

ADAS 

Jul  93 

Apr  95 

Available 

DLP 

1996 

1996 

Deferred 

APAD 

N/A 

N/A 

Part  of  PSN 

CNS 

N/A 

N/A 

Available 

KAUN/DOD 

N/A 

N/A 

Available 

Service  A  Gateway  N/A 

N/A 

Available 

MPS 

N/A 

N/A 

Deferred 

NSSFC 

N/A 

N/A 

Available 

MSN  Gateway 

Aug  94 

N/A 

Available 

HUP  Il/CFMUP 

Mar  96 

Aug  96 

Deferred 

RVP 

TBD 

TBD 

Deferred 

DUAT  Recoapete 

1994 

1994 

Deferred 

TMP 

TBD 

TBD 

Deferred 

PSM/APAD 

Circuit  604 

N/A 

N/A 

Available 

Airlines 

N/A 

N/A 

Available 

PSN/ 

FSDPS 

N/A 

N/A 

Available 

SA/CWY 

DUAT 

N/A 

N/A 

Available 

4.  PROGRAM  SUMMARY. 

4.1  MAHACEMEHI. 


This  section  describes  the  sunageaent  responsibilities  of  the  orgsnizstions 
participating  in  and  supporting  the  VNSCR  Test  and  Evaluation  (T&E)  prograsi. 

a.  Test  Policy  Review  Coaaittee  (TFRC) 

1.  Approves  the  UMSCR  TEMP. 

2.  Approves  test  policy  waivers. 
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3.  Resolves  dlsegreeaents  on  T&E  Issues  tfhen  egreesMnts  cennoc  be 
reeched  at  lower  levels  of  FAA  aanageMnc. 

4.  Chairperson  assuaes  responsibility  of  asking  final  decisions  on 
actions  brought  before  the  TPRC. 

b.  Deputy  Associate  Adainistrator  for  Systea  Engineering  and  Developaent 

(ASD) 

1.  Provides  Prograa  Hanagers  (via  ARD)  for  NAS  Acquisition  projects. 

2.  Appoints  Chairperson  of  the  TPRC. 

c.  NAS  Systea  Engineering  Service  (ASE) . 

1.  Reviews  the  UMSCR  TEMP. 

2.  Provides  the  NAS-SS-1000,  Systea  Specification  requireaents  for 
inclusion  in  the  UMSCR  TEMP. 

d.  Engineering  Specialties  and  Configuration  Manageaent  Division  (ASE>600) 

1.  Serves  as  a  Secretariat  for  the  TPRC. 

2.  Verifies  coapliance  with  FAA  Orders  and  standards  related  to  T&E 
using  TPRC  approved  processes. 

e.  National  Airspace  Systea  (NAS)  Transition  and  lapleaentation  Service 

(ANS) 

1.  Serves  as  a  aeaber  of  the  TPRC. 

2.  Provides  supportability  requireaents  to  the  Associate  Project  Manager 
for  Test  (APMT)  for  inclusion  in  the  UMSCR  TEMP,  which  serves  as  guidance  to  ASH 
for  the  OT&E  Shakedotm  plan. 

3.  Reviews  the  UMSCR  TEMP. 

4.  Reviews  requireaents,  plans,  and  procedures  for  OT&E  Shakedown. 

5.  Provides  personnel  for  conducting  and/or  aonitoring  the  conduct  of 
OT&E  Shakedown. 

6.  Reviews  OT&E  Shakedown  reports. 

f.  NAS  Developaent  Service  (AND>3) 

1.  Serves  as  a  aeaber  of  the  TPRC. 

2.  Reviews  the  UMSCR  TEMP. 

g.  Facility  Systea  Engineering  Service  (AFE) 
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1.  Identifies  NAS  systea  level  requlreaents  for  Inclusion  In  WMSCR  test 
plens.  end  verifies  that  they  are  satisfied  during  the  NHSCR  T&E  prograa. 

2.  Prepares  the  NAS-SS-IOOO  (voluae  VI)  systea  specification 
requlreaents  for  Inclusion  In  the  UMSCR  TEMP  VRTM. 

h.  Weather  and  Flight  Service  (ANV) 

1.  Serves  as  a  aeaA>er  of  the  TPRC. 

2.  Provides  the  WMSCR  Prograa  Manger  (PM). 

3.  Reviews  the  WMSCR  TEMP. 

1.  Prograa  Manager  (PM)  (ANW*200) 

1.  Responsible  for  overall  aanageaent  of  the  WMSCR  project. 

2.  Presents  T&E  deployaent  Issues  to  the  DRR. 

3.  Arranges  with  APMT  for  T&E  support,  coordination,  and  aonltorlng 
through  an  annual  Prograa  Directive  (PD) . 

4 .  Approves  PDs . 

5.  Tasks  the  APMT  to  prepare  PDs  between  the  prograa  office  and  other 
FAA  organizations. 

6.  Requests  funding  for  WMSCR  T&E. 

7.  Responsible  for  receiving  TPRC  approval  for  the  WMSCR  TEMP. 

8.  Prepares  test  policy  waiver  requests  and  subalts  to  Secretariat  via 
the  Service  Director  or  Prograa  Director,  as  appropriate. 

9.  With  APMT  support,  brings  unresolved  T&E  Issues  before  the  TPRC  via 
the  TPRC  Secretariat. 

10.  Arranges  DT&E/PAT&E  support,  and  provides  technical  direction  for 

DT&E. 

11.  Reviews  DT&E  and  PAT&E  plans,  procedures,  and  reports. 

12.  RecosaMnds  approval  of  contractor  DT&E  and  PAT&E  plans,  procedures, 
and  reports  to  the  Contract  Officer  (CO). 

13.  Monitors  DT&E. 

14.  Reviews  and  approves  OT&E  Integration  and  OT&E  Operational  test 
requlresMnts ,  plans,  procedures,  and  reports. 
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15.  Monitors  OT&E  Intsgrstlon  and  OT&E  Opsrstionsl  costs. 

16.  Monitors  OT&E  Shoksdown. 

17.  Dlstrlbutos  tho  VMSCR  TEMP  and  DT&E/PAT&E  plans,  procaduras,  and 

rsports . 

Dlractor.  FAA  Tachnlcal  Cantor  (ACT)  and  Englnaarlng,  Integration,  and 
Operational  Evaluation  Service  (ACU) 

1.  Serves  as  a  ■saber  of  the  TntC. 

2.  Provides  the  APMT  for  UMSCR  as  agreed  to  with  ACM/ACU. 

3.  Reviews  UMSCR  TEMP. 

4.  Reviews  OT&E  Integration  and  OT&E  Operational  raqulreaents . 

5.  Provides  conctirrence  with  OT&E  Integration  and  OT&E  Operational  plan, 
procedures,  and  reports  prior  to  review. 

6.  Presents  \inresolved  T&E  Issties,  significant  probleas  with  test 
results,  or  T&E  policy  violations  to  the  TPRC. 

7.  Provides  T&E  assessaents  to  the  Deployaent  Readiness  Review  (ORR) 

process . 

k.  Associate  Project  Manager  for  Test  (APMT) 

1.  Acts  as  the  agent  of  the  PM  to  oversee  the  T&E  prograa. 

2.  Prepares,  coordinates,  and  approves  with  the  PM,  an  annual  PD  which 
addresses  all  T&E  activities  for  UMSCR. 

3.  Prepares  appropriate  T&E  Inputs  to  project  docuaents  as  tasked  In 

PDs. 

4.  Prepares  PDs  between  the  project  office  and  other  FAA  organizations 
to  fund  and/or  arrange  for  the  organizations'  participation/support  of  T&E 
activities. 

5.  Jointly  prepares  and  updates  the  UHS(3l  TEMP  with  the  PM. 

6.  Provides  updates  of  available  test  results  to  the  DRR. 

7.  Reviews  DT&E  requlreaents ,  plans,  procedures,  atwl  reports. 

8.  Coordinates  with  perforalng  organizations  and  aonltors  DT&E.  PAT&E, 
and  OT&E  activities. 

9.  Reviews  contractor -prepared  DT&E  plans,  procedures,  and  reports. 
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10.  Monitors  DT&E  psrfonMd  by  tho  contrsctor. 

11.  Rsvlsvs  PAT&E  roqulrsaonts .  plans,  procaduras,  and  raports. 

12.  Praparas  OT&E  Intagration  and  OT&E  Oparatlonal  raqulraaents  for 
Inclusion  in  Cha  VMSCR  TEMP. 

13.  Praparas  OT&E  Intagration  and  OT&E  Oparational  plans,  procedures,  and 

reports . 

14.  Reviews  OT&E  Shakadotm  requiraaants .  plans,  and  procedures. 

15.  Conducts  and  directs  OT&E  Intagration  and  OT&E  Oparational  testing. 

16.  Monitors  OT&E  Shakedown  and  reviews  reports. 

1.  Air  Traffic  Operational  Support  Service  (AOS) 

1.  Serves  as  a  naabar  of  the  TPRC. 

2.  Identifies  and  develops  with  the  PM  and  APMT,  the  OT&E  Shakadotm 
requiraaents  for  the  UMSCR  TEMP. 

3.  Reviews  and  approves  PDs,  as  required. 

4.  Reviews  the  UMSCR  TEMP. 

5.  Monitors  DT&E. 

6.  Reviews  OT&E  Intagration  and  OT&E  Operational  test  requiraaants, 
plans,  and  reports. 

7.  Monitors  OT&E  Integration  and  OT&E  Operational  tests. 

8.  Prepares  OT&E  Shakedown  requireaents ,  plans,  procedures,  and  reports 
in  coordination  with  ATR. 

9.  Approves,  in  coordination  with  ATR,  additional  OT&E  Shakadotm 
requireaents  that  do  not  exceed  OT&E  Shakedown  test  durations,  or  associated  costs, 
baselined  in  the  UMSCR  TEMP. 

10.  Approves  OT&E  Shakedown  plans,  procedures,  and  reports. 

11.  Directs  and  conducts  OT&E  Shakedown  as  applicable  to  AOS  OT&E 
requireaents . 

12.  Provides  personnel  for  perforaing  and/or  aonitoring  tho  conduct  of 
OT&E  Shakedown. 
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13.  Conducts  OT&E  Shsksdom  dsts  snslysls  and  prepares  OT&E  Shakedovn 

reports . 

14.  Provides  a  deployaent  recoasMndatlon  based  on  OT&E  Shakedown  results 
In  support  of  the  DKR. 

a.  Air  Traffic  Plans  and  Requlreaents  Service  (ATR) 

1.  Serves  as  a  aei^er  of  the  TPRC. 

2.  Provides  requlreaents  for  and  reviews  the  VMSCR  TEKP. 

3.  Reviews  and  approves  PDs.  as  required. 

4.  Provides  operational  expertise  and  planning  for  conducting  and 
analyzing  tests. 

5.  Reviews  DT&E  and  PAT&E  requlreaents. 

6.  Provides  and  reviews  requiresMints .  plans,  and  procedures  for  OT&E 
Integration  and  OT&E  Operational  and  OT&E  Shakedown. 

7.  Provides  and  approves  additional  test  requlreaents  that  do  not  exceed 
durations  or  costs  as  baselined  in  the  baselined  UHSCR  TEKP. 

8.  Provides  personnel  for  conducting  and/or  aonitoring  the  conduct  of 
OT&E  Integration  and  OT&E  Operational  tests  and  OT&E  Shakedown. 

9.  Reviews  OT&E  Integration  and  OT&E  Operational  test,  and  OT&E 
Shakedown  reports. 

10.  Provides  a  deploysMnt  recoaaendation  based  on  the  results  of  OT&E 
Shakedown  in  support  of  the  DRR. 

n.  Acquisition  Support  (ASU) 

1.  Serves  as  a  aaaber  of  the  TPRC. 

2.  Reviews  the  WHSCR  TEMP. 

3.  Reviews  contractor  TEMP  ami  all  OT&B/PAT&E  plans,  procedures,  and 

reports . 

4.  Reviews  and  approves  PDs,  as  required. 

5.  Verifies  coapleceness  of  prograa  by  receiving  the  final  reports  of 
OT&E  Integration  and  OT&E  Operational  testing,  and  OT&E  Shakedown. 

o.  FAA  Contracting  Officer  (CO) 

1.  Approves  OT&E  plans,  procedures,  and  reports  for  contractual 
conpl lance. 
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2.  Eiuiur«s  OT&E  Is  conductsd  in  accordancs  vich  cha  terms  of  the 

contract . 

3.  Approves  PAT&E  plans,  procedures,  and  reports  for  contractual 
coaipl  lance . 

p.  Contracting  Officer's  Technical  Representative  (COTR) 

1.  Reviews  DT&E  plans,  procedures,  and  reports. 

2.  Reviews  PAT&E  plans,  procedures,  ai^  reports. 

q.  Quality  Reliability  Officer  (QRO) 

1.  Honltors  DT&E. 

2.  Monitors  PAT&E.  Accepts  or  rejects  the  UMSCR  as  directed  by  the  CO. 

3.  Reviews  OTAE  and  PAT&E  plans,  procedures,  and  reports. 

4.  Ensures  DT&E  and  PATAE  are  conducted  In  accordance  with  the  terms  of 
the  contract. 

r.  Regional  Airway  Facilities  Divisions  (AFD) 

1.  Supports  PM  In  the  development  of  test  requirements. 

2.  Supports  PH  In  the  Implementation  of  UMSCR  test  program  at  Salt  Lake 
City,  Atlanta,  and  Leesburg. 

3.  Supports  and  participates  In  all  biases  of  OTAE  In  the  field. 

4.  Conducts  Joint  Acceptance  Inspections  (JAI). 

s.  Airway  Facilities  Sectors  (AFS) 

1.  Participates  In  UMSCR  tests  activities  as  required  by  AFD. 

2.  Participates  In  the  JAI. 

t.  System  Engineering  and  Integration  Contractor  (SEIC) 

1.  Provides  project  management  planning  and  technical  support  for  the  PM 

and  AFMT. 

2.  Provides  TAE  s\tpport  to  ACV>200,  cIm  FM,  and  the  TD. 

u.  Test  Tsms  •  Test  teams  for  monitoring  and  performing  test  activities 
will  consist  of  the  TD.  coordinators,  managers,  operators,  and  observers,  as 
required.  Specific  positions,  duties,  and  responsibilities  will  be  defined  In  the 
appropriate  test  plans. 
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4.2  INTEGRATED  SCHEDULE. 


Figure  4.2*1  shows  the  flow  of  activities  for  the  UMSCR  testing  and  evaluation 
effort.  Major  ailestones  and  dates  of  the  WMSCR  testing  prograa  are  found  in  the 
current  NAS  Master  Schedule  Baseline  Report  (NMSBR) .  Table  4.2-1  shows  the 
ailestones  and  dates  froa  the  January  1992  NMSBR. 

4.3  TEST  PLANS. 

This  section  defines  the  series  of  test  plans  that  have  been  developed  for  the 
UMSCR  project.  This  section  discusses  both  contractor  (Harris  Corporation)  and 
governaent  test  plans.  Each  test  plan  will  be  supported  by  foraal  test  procedures 
and  test  reports.  All  plans  and  procedures  require  FAA  Prograa  Manager  approval 
prior  to  the  conduct  of  the  tests. 

4.3.1  Contractor  Test  Plans. 

Harris  Corporation  has  provided  the  following  test  plans. 

4. 3 .1.1  Contractor  Test  Plan. 

The  Contractor  Test  Plan  (CTP)  defines  the  overall  test  philosophy  and  suaaarizes 
all  tests  conducted  by  Harris  Corporation.  It  defines  the  approach  and  concepts 
for  iaq>leaenting  and  controlling  the  Harris  test  prograa.  It  defines  organiza¬ 
tional  roles  and  responsibilities,  and  provides  a  flow  diagraa  for  all  Harris 
tests.  The  CTP  was  prepared  in  accordance  with  FAA'STD-024a,  appendix  II. 

Revision  01  was  approved  February  3.  1990. 

^ _ Sftitvm  Tut  gXin 

The  Software  Test  Plan  (STP)  defines  the  total  scope  of  testing  for  a  particular 
Coaputer  Software  Configuration  Itea  (CSCI).  For  the  UMSCR,  there  are  three  STPs; 
one  for  the  NVID,  one  for  the  Test  Bed  (TBED) ,  and  one  for  the  Operations  (OPS)  and 
Distribution  (DIST)  CSCIs.  The  STPs  establish  requireaents ,  describe  organizations 
and  responsibilities,  specify  resources  required,  and  provide  schedules  for  all 
CSCI  testing.  The  STPs  identify  the  individual  tests  to  be  perforaed  during  CSCI 
testing,  fora  the  basis  for  the  developaent  of  both  foraal  ami  inforaal  tests  and 
have  enabled  the  FAA  to  assess  the  adequacy  of  CSCI  test  planning.  The  STPs  also 
identify  the  requireaents  for  the  integration  of  the  individual  CSCIs  into  the 
aggregate  UMSCR  systea.  The  STPs  were  developed  in  accordance  with  Data  Itea 
Description  (DID),  DI-MCCR- 80014,  as  referenced  in  the  UMSCR  contract.  The  latest 
revised  STPs  vr»  approved  on  March  3,  1991. 
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OTtI  PATfcB  OTfcE 


FIGURE  4,2-1.  WMSCR  TEST  AND  EVALUATION  FLOW 


TABLE  4.2-1. 


UMSCR  MILESTONES 


Completed  Milestones 

Date  Completed 

Contract  Award 

07/88 

PDR 

07/89 

CDR 

01/90 

CSCI  Testa 

09/91 

Factory  Acceptance  Test 

04/92 

Site  Acceptance  Test 

05/92 

OT&E  Integration  and  OT&E 
Operational  Phase  I 

03/93 

Scheduled  Milestones 

Start 

Completed 

OT&E  Integration  and 

OT&E  Operational 

Phase  II 

Regression 

06/94 

07/94 

07/94 

07/94 

0T6£  Shakedown 

08/94 

08/94 

DRR 

09/94 

ORD 

09/94 

TRANSITION 

09/94 

12/94 
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The  FAT  was  performed  to  validate  the  function  of  the  system  at  the  contractor's 
test  facility  and  was  witnessed  by  the  FAA.  The  FAT  demonstrated  the  adequacy  of 
the  VMSCR  design  by  testing  all  aspects  of  system  function  and  performance,  as 
defined  In  the  system  specification.  The  FAT  plan  defined  the  range  of  tests, 

Input  data,  Initialization  requirements,  expected  output,  and  test  success 
criteria.  Testing  resources  such  as  personnel,  equipment  facilities,  and  schedules 
were  Identified.  Upon  the  successful  completion  of  the  FAT,  the  WHSCR  was 
transported  to  and  Installed  In  Its  Intended  field  environment. 

System  performance  testing  during  FAT  was  performed  under: 

a.  Normal  data  flow  and  normal  operating  conditions, 

b.  Limit  and  overload  conditions, 

c.  Erroneous  data  Input  and  abnormal  operating  conditions, 

d.  Failure  and  recovery  conditions. 

The  FAT  Plan  was  prepared  In  accordance  with  appendix  II  of  FAA-STD-024a  and 
approved  on  November  8,  1991. 

^.3.1.4 _ Site  Acceptance  Test  Plan. 

The  SAT  was  performed  to  validate  the  fiuictlon  and  performance  of  the  system 
(previously  demonstrated  by  the  FAT  at  the  contractor's  test  facility)  In  Its 
Intended  field  test  environment.  This  test  used  all  available  actual  field  stimuli 
and  Inputs.  Field  Inputs  not  available  were  simulated  xislng  the  WHSCR  built* In 
simulator  function.  The  SAT  plan  defined  the  range  of  tests,  system  Initialization 
requirements.  Input  data,  expected  output,  and  criteria  for  evaluation.  Test 
resources  such  as  personnel,  equipment,  facilities,  and  schedules  were  also 
Identified. 

System  performance  testing  for  the  SAT  was  performed  under: 

a.  Normal  data  flow  and  normal  operation  conditions, 

b.  Failure  and  recovery  condi  :lon. 

The  SAT  plans  were  prepared  In  accordance  with  appendix  II  of  FAA-STD-024a.  The 
NUID  SAT  plan  was  approved  on  April  29,  1991.  The  SAT  plans  for  the  nodes  were 
approved  In  February  1992. 

4.3.2 _ fAA  Itat  Flana- 

4.342..1 _ QT&E  Intctration  and  QI&E  Operitignil  flan- 

The  OT&E  Integration  and  OT&E  Operational  plan  defines  the  scope  of  the  operational 
testing  to  be  performed  to  Integrate  the  WHSCR  Into  the  NAS  environment.  The  plan 
covers  basic  Interface  and  Intersystem  communications.  At  the  NAS  level,  data 
flows  to  and  from  available  end-users  will  be  verified  and  will  Include  operational 
command  and  request/reply  sequences  with  ava5.1able  representation  from  each  user 
category . 
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The  OT&E  Integration  and  OT&E  Operational  plan  was  prepared  by  ACV-200  In 
accordance  with  appendix  II  of  FAA*STD-024a  and  approved  In  October  1991. 

4. 3. 2. 2 _ OT&E  Shakedown  Plan. 

The  OT&E  Shakedown  plan  defines  the  scope  of  the  operational  testing  to  be 
performed  to  verify  the  operational  effectiveness  and  suitability  of  the  WMSCR 
for  use  In  the  NAS.  OT&E  Shakedown  will  determine  the  operational  readiness  of 
personnel,  procedures,  and  the  system  to  assume  field  operational  status. 

The  OT&E  Shakedown  plan  was  prepared  by  AOS-S30  In  accordance  with  appendix  11 
of  FAA-STD-024a.  As  necessary  to  ensure  an  effective  shakedown,  AOS-530  has 
coordinated  OT&E  requirements  with  the  cognizant  Air  Traffic  (AT)  organizations. 
The  OT&E  Shakedown  plan  was  approved  on  February  11,  1991. 


5.  DEVELOPMENTAL  TEST  AND  EVALUATION/PRODUCTION  ACCEPTANCE  TEST  AND  EVALUATION 

(DI&E/PAI&E)  • 


5.1_  DT&E/PAT&E  TO  DATE. 

5 .  lU _ Contractor  Informal  DT&E. 

All  Informal  contractor  testing  has  been  completed.  All  Unit,  Computer  Software 
Component  (CSC)  and  CSC  Integration  testing  was  successful.  There  are  no  carry¬ 
over  action  Items  resulting  from  these  Informal  tests. 

5.1.2 _ Contractor  Formal  DT&E/PAT&E. 

All  formal  CSCl  tests,  FAT,  and  SAT  tests  have  been  completed.  All  required  test 
reports  have  been  reviewed  and  approved  by  the  Program  Office.  There  are  no  carry¬ 
over  action  Items  resulting  from  these  formal  tests. 

5. 1.2.1  Functional  Tests. 

The  following  are  the  functions  evaluated  during  the  FAT  (OT&E)  and  SAT  (PAT&E) : 

a.  System  failures  and  reconfiguration.  Elements  of  the  WMSCR  node  were 
selectively  failed  to  demonstrate  that  the  system  successfully  substitutes 
redundant  elements  with  no  Impact  on  system  operation. 

b.  Processor  failover.  One  VAX  6220  processor  at  a  node  was  failed  to 
demonstrate  the  failover  to  the  backup  processor  with  no  more  than  a  lO-second 
Interruption  In  user  service. 

c.  Nodal  switchover.  One  node  was  failed  to  demonstrate  that  the  system  Is 
capable  of  resuming  service  to  all  users  In  the  single  node  configuration. 

d.  Nodal  startover.  The  failed  node  was  restarted  after  a  failure  and 
brought  back  to  fully  operational  condition  Including  the  resvunptlon  of  service  to 
users . 
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e.  Operator  takeover.  This  test  demonstrated  the  WMSCR  capability  to  allow 
the  operator  at  one  node  to  perform  the  coordination  and  actions  necessary  to 
assume  control  of  the  complete  UMSCR  network  at  one  node. 

5,1. .2^ _ Performance  Tests. 

The  following  performance  tests  were  accomplished  during  the  FAT  (DT&E)  and  SAT 
(PAT&E) : 

a.  Data  retrieval  performance  tests  were  performed  in  the  single  and 
dual  node  configurations  under  the  "peak  +  margin"  traffic  load  as  defined  in 
appendix  I,  section  10  of  FAA-E- 2764c.  These  tests  will  verify  the  requirements 
of  paragraph  3. 1.4. 3. 6. 3  of  FAA-E-2764c. 

b.  Processing  performance  tests  were  also  performed  in  the  single  and 
dual  node  configurations  under  the  "peak  -t-  margin"  traffic  load  as  defined  in 
appendix  I,  section  10  of  FAA*E-2764c.  These  tests  will  verify  the  requirements 
of  paragraph  3. 1.4. 2. 6  of  FAA-E- 2764c. 

c.  Operator  command  performance  tests  were  performed  in  the  dual  node 
configuration  under  the  "peak"  traffic  load  as  defined  in  appendix  I,  section  10 
of  FAA-E-2764C.  These  tests  verified  all  requirements  associated  with  operator 
command  responses  as  defined  in  FAA-E*2764c. 

5.2  FUTURE  DT&E/PAT&E. 

5.2.1  Future  DT&E. 

None.  All  contractually  required  DT6£  has  been  completed. 

5.2 .1.1  Future  DT&E  Objectives. 

Not  applicable. 

5. 2. 1.2  DT&E  Events/Scope  of  Testing/Basic  Scenarios. 

Not  applicable. 

5.2.2  Future  PAT&E. 

None.  All  contractually  required  PAT6£  has  been  completed. 

5. 2. 2.1  Future  PAT&E  Oblectlves. 

Not  applicable. 

5. 2. 2. 2  PAT&E  Events/Scooe  of  Testing/Basic  Scenarios. 


Not  applicable. 
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Issues  resolved  at  the  FAT  were; 


a.  Key  system  functions  as  previously  discussed  in  paragraph  5. 2. 1.2.1. 

b.  System  performance  as  previously  discussed  in  paragraph  5. 2. 1.2. 2. 

S.3.2 _ Critical  PAT&E  Issues. 

?. 3.2.1 _ Interface  Availability  for  SAT. 

No  actual  system  Interfaces  were  available  for  the  SAT.  The  UMSCR  built-in 
simulator  was  used  to  verify  the  operation  of  the  interfaces.  Testing  with 
live  interfaces  has  been  postponed  into  OT&E  Integration  and  0T££  Operational 
or  deferred  as  Indicated  in  section  4  and  the  appendix  A,  Test  Verification 
Requirements  Traceability  Matrix  (TVRTM) . 

3,JL. 2 ..2 _ Test  Data  Sets  for  SAT. 

The  test  data  sets  to  be  used  with  the  Network  Simulator  were  developed  to  provide 
realistic  and  adequate  test  scenarios. 


6.  OPERATIONAL  TEST  AND  EVAUJATION  (OT&E) /INTEGRATION. 


6.1  OT&E  INTEGRATION  AND  OT&E  OPERATIONAL  TO  DATE. 

The  OT&E  Integration  and  OT&E  Operational  is  in  progress.  As  test  results  are 
published,  they  are  distributed  for  review.  To  date,  the  following  0T6£ 
Integration  and  OT&E  Operational  reports  have  been  completed: 

a.  VMSCR/NMC  Quick  Look  Report  1/93. 

b.  UMSCR/NADIN  II  Quick  Look  Report  1/93. 

c.  VHSCR/WMSCR  Operator  Quick  Look  Report  2/93. 

d.  VMSCR/Other  UMSCR  Intemodal  Quick  Look  Report  3/93. 

e.  UMSCR/CTS  Quick  Look  Report  4/93. 

f.  WHSCR/ADAS  Interim  Test  Report  10/93. 

g.  WMSCR/NSSFC  Alternate  Link  Test  Report  1/94. 

6.2  FUTURE  OT&E  INTEGRATION  AND  OT&E  OPERATIONAL. 

6.2.1  OT&E  INTEGRATION  AND  OT&E  OPERATIONAl^ OMECXIVES . 

The  OT&E  Integration  and  OT&E  Operational  will  verify  WHSCR  operational 
requirements  at  the  NAS  system  and  subsystem  levels  in  accordance  with 
volumes  I,  II,  and  V  of  NAS -SS- 1000. 


The  OT&E  Integration  and  OT&E  Operational  will  verify  the  ability  of  the  WMSCR 
to  properly  interface  and  function  with  other  NAS  subsystems  and  to  verify  the 
operational  effectiveness  and  suitability  of  the  WMSCR  when  fully  integrated  into 
the  NAS. 

The  WMSCR  OT&E  Integration  and  OT&E  Operational  will  be  conducted  by  ACW-200B  at 
the  Salt  Lake  City,  Atlanta,  and  Leesburg  operational  test  sites.  In  accordance 
with  FAA  Order  1810. 4B,  all  WMSCR  related  subsystem  interfaces  will  be  tested. 
Where  the  actual  subsystem  is  not  available,  emulation  of  that  NAS  subsystem  will 
be  used,  except  in  those  cases  where  the  subsystem  has  not  yet  been  baselined.  In 
these  cases,  the  NAS-SS-1000  requirements  will  be  deferred. 


Scenarios . 

A  building  block  approach  will  be  employed  in  the  implementation  of  the  WMSCR  OT&E 
Integration  and  OT&E  Operational  process.  This  approach  provides  an  orderly 
sequence  of  tests  to  establish  baseline  performance. 

The  following  sequences  will  be  used  as  a  reference  point  to  construct  a  test 
baseline  for  the  operational  WMSCR  system.  This  baseline  will  include  gathering  a 
weather  and  NOTAM  information  database  that  will  be  used  in  conjunction  with  the 
distribution  and  communications  functions. 

a.  Initial  WMSCR  OT&E  Integration  and  OT&E  Operational  will  begin  with  a 
subset  of  WMSCR  operator  functions  which  will  include  startup  procedures, 
diagnostics,  and  system  configuration  parameters. 

b.  National  Meteorological  Center  (NMC)  -  WMSCR.  This  test  will  obtain  and 
verify  an  operational  database  in  accordance  with  Federal  Coordinator  for 
Meteorological  Service  Standards  (FCM-S2)  and  World  Meteorological  Organization 
(WMO)  weather  format  standards.  After  obtaining  a  valid  weather  database,  the 
WMSCR  operator  console  will  be  exercised. 

c.  WMSCR  -  Aviation  Weather  Processor  (AWP) .  This  test  will  verify  the 
ability  of  the  WMSCR  to  exchange  NOTAM  and  weather  data  with  the  AWP. 

d.  Coded  Time  Source  (CTS)  to  WMSCR.  This  test  will  verify  WMSCR 
synchronization  with  the  CTS. 

e.  WMSCR  •  CNSP.  Testing  with  the  CNSP  is  deferred.  This  group  of  tests 
will  be  structured  to  test  the  existing  CNS  to  WMSCR  after  CMS  has  been  relocated 
and  an  X.25  interface  has  been  developed.  This  test  will  verify  that  WMSCR  is 
capable  of  receiving  unprocessed  NOTAMs  from  the  subsystems/users,  forwarding  them 
to  the  CNS,  and  accepting  processed  NOTAMs  from  the  CMS  for  distribution  to  the 
subsystem/users . 

f.  WMSCR  -  NADIN  II  PSN.  The  PSN  X.25  protocol  conformance  process  to  be 
described  and  defined  by  the  FAA  will  be  executed  prior  to  any  further  testing  with 
WMSCR  users  over  the  PSN. 
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g.  WMSCR  •  PSN  Users.  Upon  successful  verification  of  the  NAS  requirements 
for  the  above  sequences  (a.  through  f.),  WMSCR  OT&E  Integration  and  OT&E 
Operational  will  verify  the  interface  requirements  of  the  users  that  enq>loy  the 
NAOIN  PSN  as  an  intermediate  pathway. 

The  WMSCR  OT&E  Integration  and  OT&E  Operational  supports  string  testing  through  the 
NADIN  PSN  to  the  end- state  subsystem,  however,  does  not  assume  responsibility  for 
the  success  or  failure  of  that  string. 

The  WMSCR/NADIN  PSN  users  by  design  have  common  interface  characteristics.  The 
testing  of  WMSCR/NADIN  PSN  users  will  verify  the  general  requirements  of  the  WMSCR 
to  distribute  weather  and  NOTAM  information  to  each  of  the  users.  The  tinique 
weather  and  NOTAM  requirements  for  each  user  will  be  tested.  Testing  will  verify 
the  capability  of  WMSCR  to  store  data  received  from  users  and  to  selectively 
distribute  required  data  to  each  user.  WMSCR  support  of  existing  user 
request/reply  services  will  also  be  evaluated  as  necessary. 

^■2 J _ Test  Configurations  and  Catesories. 

The  WMSCR  OT&E  Integration  and  OT&E  Operational  will  employ  five  configurations 
which  represent  logical  groups  within  the  MAS  environment.  Within  each  test 
configuration  are  test  categories  which  represent  the  WMSCR  stibsystems/users . 

Each  category  will  verify  the  WMSCR  processing  and  distribution  functions  for 
weather  and  NOTAM  message  types  and  operational  interface  requirements.  The  test 
categories  will  provide  a  uniform  interface  for  testing  data  formats  and  procedures 
for  all  communications  circuits,  independent  of  the  data  types,  protocols,  and 
formats  in  use  on  the  circuit. 

The  test  configurations  and  categories  are: 

62.3.1 _ Test  Confiauration  #1. 

Test  Configuration  #1  will  test  the  communications  function  of  those  NAS 
subsystems/users  that  are  directly  connected  to  a  WMSCR  node. 


Category  Subsvstem/User 


A  WMSCR  Operator; 

B  National  Meteorological  Center  (MMC) ; 

C  Aviation  Weather  Processor  (AWP) ; 

D  Coded  Time  Source  (CTS); 

E  Consolidated  NOTAM  System  Processor  (CNSP) ; 


NOTE:  CNSP  tests  are  deferred.  CNS  will  be  tested  to  WMSCR  via  the  PSN. 
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Test  Conflgurstion  #2  will  test  the  cosonmlcetlons  function  of  those  NAS  subsystems 
which  interface  to  the  VntSCR  node  as  UMSCR/NAOIN  PSN  users. 


Category  Subsvstem/User 


F  Other  WMSCR  Node 

G  Central  Flow  Meteorologist  Weather  Processor  (CFMWP) 

H  Real-Time  Weather  Processor  (RWP) 

I  Automated  Weather  Observation  System  Data  Acquisition  System  (ADAS) 

J  Department  of  Defense/Tinker  Air  Force  Base  (DOD/AWN) 

K  National  Severe  Storms  Forecast  Center  (NSSFC) 

L  Data  Link  Processor  (DLP) 

M  Maintenance  Processor  Subsystem  (MPS) 

N  Traffic  Management  Processor  (TMP) 

0  Meteorologist  Weather  Processor  (MWP) 

P  Direct  User  Access  Terminal  (DUAT) 

Q  Graphics  Weather  Display  System  (GWDS) 

R  External  Users  (External  to  the  NAS) 

6. 2. 3. 3  Test  Configuration  #3. 

Test  Configuration  #3  will  test  the  communications  function  of  those  NAS  subsystems 
which  interface  to  the  WMSCR  node  as  UMSCR/NADIN  MSN  users. 

Category  Subsvstem/User 

S  External  Users;  (e.g..  Host) 

T  International  Users;  (e.g.  Aeronautical  Fixed  Telecommunications 

Network  (AFTN) 

6. 2. 3. 4  Test  Configuration  #4. 

Test  Configuration  #4  will  test  the  communications  function  of  those  NAS  subsystems 
which  interface  to  the  WMSCR  node  as  WHSCR/NADIN  APAD  users. 

Category  Subsvstem/User 

U  External  Users;  (e.g.,  commercial  airlines) 

6 .2. 3. 5  Test  Configuration  <5. 

Test  Configuration  #5  will  teat  the  communications  functions  for  the  total  system 
network  of  WMSCR  users. 

Category  Subsvstem/User 

V  Total  WMSCR  System  Performance,  Capacity  and  Expansion 
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6.3  CRITICAL  QT&E  INTEGRATION  AND  OT&E  OPERATIONAL  ITEMS. 

LlUi _ Available  Interfaces. 

Interfaces  that  will  be  available  for  OT&E  Integration  and  OT&E  Operational 
and  those  that  may  require  simulators  or  drivers  must  be  identified  during  the 
development  of  the  OTU  Integration  and  OT&E  Operational  plan  and  procedures. 

The  start  of  OT&E  Integration  and  OT&E  Operational  for  configurations  2  through  5, 
listed  in  section  6.2.3,  is  dependent  upon  the  availability  of  the  NADIN  PSN.  See 
also  paragraph  3. 5. 2. 2  and  table  3. 5. 2. 2-1  of  this  TEMP. 

LlI^ _ PSN  Conformance. 

Prior  to  connection  to  the  PSN  for  either  testing  or  operation,  each  user  will  be 
required  to  go  through  the  NADIN  PSN  conformance  verification  process. 


7.  OT&E/SHAKEDOWN. 

Shakedown  testing  is  planned  and  conducted  by  AOS-530.  As  the  final  phase  of  OT&E, 
the  purpose  of  Shakedotm  is  to  evaluate  the  system  in  its  operational  environment. 
Shakedown  testing  verifies  the  integrated  readiness  of  personnel,  procedures,  and 
the  system  to  assvime  field  operational  status. 

Shakedown  testing  focuses  on  man-machine  interface  and  system  support  issues. 

Test  issues  Include  human  factors  of  using  and  maintaining  the  system,  and  include 
programs  developed  concurrently  with  the  system  including  logistics  support, 
training,  procedures,  and  documentation.  These  prograois  have  been  evaluated 
individually  during  system  development.  Shakedown  testing  is  an  evaluation  of 
the  Integrated  effectiveness  of  these  programs  to  determine  the  suitability  and 
maintainability  of  the  system  prior  to  implementation  into  the  NAS. 

7.1  OT&E  SHAKEDOWN  TO  DATE. 

None  to  date. 

7.2  FUTURE  OT&E  SHAKEDOWN. 

L^IA _ OT&E  Shakedown  Oblectives. 

OT&E  Shakedown  testing  is  performed  on  the  system  to  determine  the  system 
operational  effectiveness  and  suitability.  Operational  effectiveness  is  defined 
as  the  degree  to  which  the  system  accomplishes  its  mission  in  the  context  of 
procedures,  policy,  and  field  environment  when  operated  as  planned.  Suitability 
Issues  include  support,  documentation,  human  factors,  training,  and  procedures. 

Shakedown  testing  is  conducted  to; 

a.  Identify  and  evaluate  the  risk  associated  with  deployment  of  the  system. 

b.  Identify  any  hardware  or  software  modifications  required  prior  to 
deployment . 
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c.  Identify  any  critical  Issues  that  may  have  an  adverse  impact  on  system 
operation  in  the  field. 

d.  Verify  that  the  Integrated  system  is  ready  for  full  operation  within  the 

NAS. 

7.2.2  OT&E  Shakedown  Events/Scooe  of  Testing/Basic  Scenarios. 

7. 2. 2.1  Shakedown  Test  Approach. 

Shakedown  testing  requires  a  unique  approach.  The  test  must  evaluate  all  aspects 
of  the  system  use  and  maintenance  imder  realistic  field  conditions.  Previous 
testing  has  validated  specification  and  NAS  interface  requirements. 

7- 2.2.2  Assumptions. 

Shakedown  planning  is  approached  with  the  following  assustptions: 

a.  The  system  meets  all  specification  and  interface  requirements. 

b.  The  work  force  is  proven  (the  system  operators  and  maintalners  have  the 
aptitude  for  the  type  of  work) . 

7. 2. 2. 3  Focus  and  Issues. 

Shakedo%m  testing  is  a  test  of  maintainability  and  xiseability.  Testing  focuses  on 
issues  and  programs  that  enable  use  and  isaintenance  of  the  system  and  include  the 
following: 


a.  Htuian  Factors.  These  include  data  displays,  safety,  labor  intensiveness, 
and  other  user  functions. 

b.  Training.  People  trained  on  the  system  can  accomplish  assigned  tasks. 

c.  Procedures.  Procedures  to  operate  the  system  are  in  place  and  provide 
straightforward  and  effective  means  to  accomplish  user  requirements. 

d.  Logistics  Support.  Support  meets  the  maintenance  requirements  throughout 
the  life  cycle  of  the  system. 

e.  Other  Factors.  Reliability,  maintainability,  and  availability  (RMA) , 
compatibility,  and  manpower  supportabili^. 

This  approach  is  not  intended  to  limit  the  scope  of  testing  but  does  provide  focus. 
Some  functional  testing  may  be  required  to  satisfy  specific  user  concerns  or 
because  previous  testing  was  incomplete  due  to  laboratory  constraints  at  the  time. 

Test  results  are  rated  in  terms  of  operational  impact.  Based  on  test  results,  the 
risks  of  use  in  the  field  are  evaluated.  The  results  are  forwarded  to  AAF-11  in  a 
Quick  Look  Report  that  assesses  the  risks  of  system  deployment  and  is  used  to  aid 
the  EXCOH  chairman  in  rendering  a  final  deployment  decision. 
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7. 2. 2.4 _ Shakedotm  Test  Scope. 

Shakedown  testing  will  evaluate  the  system  under  realistic  field  conditions. 
Testing  will  be  designed  to  reflect  the  integrated  readiness  of  people,  procedures, 
and  the  system  to  assume  operational  status.  Shakedown  will  evaluate: 

a.  Field  operations, 

b.  Field  hardware  and  software  maintenance, 

c.  AOS -530  hardware  and  software  support, 

d.  Contractor  hardware  and  software  support. 

7.1  CRITICAL  OT&E  SHAKEDOWN  ITEMS. 

Items  critical  to  the  completeness  and  success  of  the  OT&E  Shakedown  are: 

a.  Availability  of  the  user  system  and  completion  of  their  NADIN  II 
conformance  testing. 

b.  Successful  completion  of  OT&E  Integration  and  OT&E  Operational  for  \iser 

systems. 


8.  SPECIAL  RESOURCE  SUMMARY. 


8.1  TEST  ARTICLES. 

The  VHSCR  system  will  consist  of  two  nodes.  The  nodes  will  be  located  in  the 
NAWPFs  at  the  Atlanta  and  Salt  Lake  City  Air  Route  Traffic  Control  Centers 
(ARTCCs) . 

The  WMSCR  test  program  will  be  conducted  on  individual  software  elements  during 
development  and  on  the  complete  system  as  part  of  the  FAT  and  SAT. 

OT&E  Integration  and  OT&E  Operational  and  OT&E  Shakedown  will  be  conducted  on  the 
complete  system  installed  in  the  designated  operational  environment.  A  Service  "A” 
Gateway  will  be  made  available  at  the  FAA  Technical  Center  and  connected  to  the 
local  node  of  the  NADIN  PSN  Pilot  network  to  support  user  testing  for  categories  R 
and  U. 

After  (MID  the  VMS(3l  will  assusM  operational  responsibilities  for  the  collection  and 
distribution  of  weather  and  NOTAM  data.  The  conrplete  transition  is  expected  to 
take  as  long  as  1  year.  The  UMS(Ml  Transition  Plan  describes  the  transition  from 
UMSC  to  WMSCR. 

8.2  SPECIAL  SUPPORT  REQUIREMENTS. 


There  are  no  special  support  requirements  for  the  WMSCR  system. 
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?  > ..  ACROmS .  AMP  ABBREVIATIONS  • 


Ai 

ACU 

ADAS 

AFD 

AFE 

AFS 

AFTN 

ANS 

ANU 

AOS 

APAD 

APHT 

ARTCC 

ASD 

ASE 

ASU 

AT 

ATL 

ATR 

AUOS 

AWP 

CDR 

CE 

CFHtfP 

CNS 

CNSP 

CO 

COTR 

CSC 

CSCI 

CTP 

CTS 

DID 

DIST 

DLP 

DOD 

DOD/AUN 

DRR 

DT&E 

DUAT 

FAA 

FAT 

FCM 

FSDPS 

GWDS 

I /CO 

IRD 

JAI 

KAVN 


Inherent  Avelleblllty 

Engineering,  Integration,  and  Operational  Evaluation  Service 

AUOS  Data  Acquisition  System 

Regional  Airway  Facilities  Division 

Facility  System  Engineering  Service 

Airway  Facilities  Sector 

Aeronautical  Fixed  Telecommunication  Network 

NAS  Transition  and  Implementation  Service 

Ueather  and  Flight  Service 

Air  Traffic  Operational  Support  Service 

Asynchronous  PAD 

Associate  PM  for  Test 

Air  Route  Traffic  Control  Center 

System  Engineering  and  Development  Service 

System  Engineering  Service 

Acquisition  Support 

Air  Traffic 

NAUPF,  Atlanta,  Georgia 

Air  Traffic  Plans  and  Requirements  Service 
Automated  Ueather  Observation  System 
Aviation  Ueather  Processor 
Critical  Design  Review 
Critical  Equipment 

Central  Flow  Meteorologist  Ueather  Processor 
Consolidated  NOTAM  System 
Consolidated  NOTAM  System  Processor 
Contracting  Officer 

Contracting  Officer's  Technical  Representative 

Computer  Software  Component 

Computer  Software  Configuration  Item 

Contractor  Test  Plan 

Coded  Time  Source 

Data  Item  Description 

Distribution  CSCI  of  UMSCR 

Data  Link  Processor 

Department  of  Defense 

Department  of  Defense/Tinker  Air  Force  Base 

Deployment  Readiness  Review 

Development  Test  and  Evaluation 

Direct  User  Access  Terminal 

Federal  Aviation  Administration 

Factory  Acceptance  Test 

Federal  Coordinator  for  Meteorological  Services 

Flight  Services  Data  Processing  System 

Graphics  Ueather  Display  System 

Installation  and  Check  Out 

Interface  Requirements  Document 

Joint  Acceptance  Inspection 

Tinker  Air  Force  Base 
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LRU 

MPS 

MSN 

MTBF 

MTTR 

MWP 

N/A 

NADIN 

NAS 

NAWPF 

NMC 

NMSBR 

NOTAM 

NSSFC 

NUS 

NWSTG 

OPS 

ORD 

OTAE 

PAD 

PAT&E 

PD 

PIDB 

PM 

PSN 

QRO 

RMA 

RWP 

SAT 

SCN 

SEIC 

SIDB 

SLC 

SSR 

STP 

T&E 

TBED 

TEMP 

TMP 

TPRC 

TVRTM 

UT 

VRTM 

WCP 

UMO 

WMSC 

UMSCR 


Lowest  Repairable/Replaceable  Unit 
Maintenance  Processor  System 
Message  Switch  Network 
Mean  Time  Between  Failures 
Mean  Time  To  Repair 
Meteorologist  Weather  Processor 
Not  Applicable 

National  Airspace  Data  Interchange  Network 
National  Airspace  System 

National  Aviation  Weather  Processing  Facility 
National  Meteorological  Center  (same  as  NWSTG) 

NAS  Master  Schedule  Baseline  Report 
Notice  to  Airmen 

National  Severe  Storms  Forecast  Center 
National  Weather  Service 

National  Weather  Service  Telecommunications  Gateway 

Operations  CSCI  of  WMSCR 

Operational  Readiness  Date 

Operational  Test  and  Evaluation 

Packet  Assembler/Disassembler 

Production  Acceptance  Test  and  Evaluation 

Program  Directive 

Product  Information  Data  Base 

Program  Manager 

Packet  Switching  Network 

Quality  Reliability  Officer 

Reliability,  Maintainability,  and  Availability 
Real-time  Weather  Processor 
Site  Acceptance  Test 
Specification  Change  Notice 

System  Engineering  and  Integration  Contractor 

Station  Information  Data  Base 

Salt  Lake  City,  Utah  -  The  NAWPF 

Software  Specification  Review 

Software  Test  Plan 

Test  and  Evaluation 

Test  Bed  CSCI  of  WMSCR 

Test  and  Evaluation  Master  Plan 

Traffic  Management  Processor 

Test  Policy  Review  Coanlttee 

Test  Verification  Requirements  Traceability  Matrix 
Unit  Test 

Verification  Requirements  Traceability  Matrix 
Weather  Communications  Processor  (now  DLP) 

World  Meteorological  Organization 

Weather  Message  Switching  Center 

Weather  Message  Switching  Center  Replacement 
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APPENDIX  A 

TEST  VERinCATlON  REQUIREMENTS  TRACEABILITY  MATRIX  (TVRTM)  ,  NAS-SS-1000 


VOLUME  I  TEST  VERIFICATION  REQUIREMENTS  TRACEABILITT  MATRIX  -  TVRTM 
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VOLUME  II  TEST  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX  -  TVRTM 
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3.2.1.5.7.1.2.B.2  MO 

D 

D 

mm 

D 

3.2.1.5.7.1.2.B.3  ICAO 

D 

D 

H 

D 

3.2.1.5.7.1.2.B.4  OFCM 

D 

D 

1 

D 

3.2.1.5.7.1.3  DATA  OOLLECnOR  AID  DISTUBOTIOI 

D 

D 

X 

X 

l/A-TITLE 

3.2.1.5.7.1.3.1.A  SORPACE  OBS  DATA  OOLLKTIOi 

D 

D 

D 

3.2.1.5.7.1.3.1.B  PORBCAST  DATA  OOLLECTKM 

D 

D 

D 

3.2.1.5.7.1.3.1.C  OPPER  AIR  OBS  OOLLBCnOi 

D 

D 

D 

3.2.1.5.7.1.3.1.D  PROCESSED  R0TAI6  IN  dSP 

D 

D 

X 

Q  (6) 

3.2.1.S.7.1.3.1.E  PROCESSED  BOTANS  FM  ARP 

D 

D 

D 

3.2.1.S.7.1.3.1.P  n  RARRUGS  AID  ADVISORIES 

D 

D 

D 

3.2.1.S.7.1.3.2  DATA  DISTRIBRIOI 

D 

D 

D 

1 

3.2.1.S.7.1.3.3  DATA  PRIORITIES 

D 

D 

D 

1 

3.2.1.5.7.1.4.A  RI  UFO  -  IAS  SDBSTSTERS 

D 

D 

D 

i 

3.2.1.S.7.1.4.B  MX  UFO  •  EXTERIAL  USERS 

D 

D 

X 

D 

« 

3.2.1.5.7.1.4.C  NX  UFO  -  lATIOIAL  RUTIER  SEIVia 

D 

D 

X 

D 

1 

3.2.1.5.7.1.4.D  NX  UFO  •  UTEHATIOIAL 

D 

D 

X 

D 

3.2.1.S.7.1.5.A  PBDVIDB  ALL  BACEDP  FDRCnOK 

D 

D 

X 

D 

3.2.1.S.7.1.5.B  EXCHAKE  DATA 

D 

D 

X 

D 

3.2.1.5.7.1.6  OPERATOR  ilTERVEHIOi 

D 

D 

X 

D 

3.2.1.5.7.1.7.1  NAHTEIAICI WKTORIK 

D 

D 

X 

D 

D 

D 

X 

D 

D 

D 

X 

X  (5) 

X  (5) 

3.2.1.5.7.1.9  NAHTEUBCE  OOWADS 

D 

0 

X 

1(5) 

X  (5) 

3.2.1.5.7.1.10.A  UgOESI  REPLY  *  HIEIUTIOUL  USERS 

D 

D 

X 

D 

3.2.1.5.7.1.10.B  REQUISr  REPUT  •  NIUTAR  OmCES 

D 

D 

X 

D 

3.2.1.5.7.1.10.C  REQUEST  REFIT  -  SERVICE  EXT  SUBSCRIBERS 

D 

D 

X 

D 

1 

3.2.1.5.7.1.11  STADUD  TINE  SOURCE 

0 

D 

X 

D 

3.2.1.S.7.2  PERFURHAICE  ClARACTERISnCS 

L 

L 

X 

L 

3.2.1.S.7.2.1  DATA  RREITIOI 

T 

T 

X 

T 

3.2.1.5.7.2.1.A  SORPAa  OBSOVAnORS 

T 

T 

T 

T 

3.2.1.5.7.2.1.B  UPPER  AIR  OBSERVATION 

T 

T 

T 

T 

3.2.1.5.7.2.1.C  PntEPS 

T 

T 

T 

T 

3.2.1.S.7.2.1.0  PORBCAST  DAU 

T 

T 

T 

T 

3.2.1.S.7.2.1.B  NITBOBOLOGICAL  DISCUSSIOR  PROOOCTS 

T 

T 

T 

T 

3.2.1.5.7.2.1.P  NX  HAmiGS  AID  ADVISORIES 

T 

T 

T 

T 

D 

D 

D 

D 

3.2.1.5.7.2.3  DATA  RIQ0ISTS/DR6EII  TBRODGIPOT 

AT 

T 

X 

AT 

3.2.1.5.7.2.4  NESSliGI  DISTROOnOR 

AT 

T 

X 

X 

X 

I/A-TITIE  ' 

3.2.1.5.7.2.4.1.A  NESSAGE  PRIORITT  LEVEL  1 

D 

D 

D 

D 

1 

( 

3.2.1.5.7.2.4.1.B  NESSAN  PRIORm  LEVEL  2 

D 

D 

D 

D 

i 
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sicnoi  3 

REQOIRIIIERS  PARAGRAPB  REFEREICB 

FOR  IAS-SS-1000  Va  II  (SCI-U) 

PUl  / 

TITLE 

3.2.1.5.7.2.4.1.C  nssia  PUGRirr  UVEL  3 

3.2.1.5.7.2.4.1.D  NBSSia  PIIORIR  LEVEL  4 

3.2.1.S.7.2.4.1.B  MESSAGE  PRIORIR  LEVEL  5 

3.2.1.S.7.2.4.2 

PRIORITT  REOOOITIOi 

3.2.1.5.7.2.5 

OPERATIOi 

3.2.1.5.7.2.6 

MESSAGE  JOORIALLIIG 

3.2.1.5.7.2.7 

MAimiAICE  REPORTUG  PERfORNAKE 

3.2.1.5.7.2.8 

STAIOARO  TIME  SOORCE 

3.2.1.5.7.3-l.A 

ADASTOfMSCR 

3.2.1.5.7.3-l.B 

AMTOMGCR 

3.2.1.5.7.3-l.C 

mSCRTO  AH 

3.2.1.5.7.3-l.D 

ARPTOHSCR 

3.2.1.5.7.3-l.E 

HSCRTOAH 

3.2.1.5.7.3-l.P 

CPWP10HSCR 

3.2.1.5.7.3-l.G 

HSCR10CFMHP 

3.2.1.5.7.3-I.I 

CISPIOHSCR 

3.2.1.5.7.3-I.I 

HSCRTOdSP 

3.2.1.5.7.3-l.J 

BOAT  to  fMSCR 

3.2.1.5.7.3-l.K 

MNSCRIODOAT 

3.2.1.5.7.3-l.L 

EROSERtDHSCR 

3.2.1.5.7.3-lJ 

MNSCR  to  En  OSER 

3.2.1.5.7.3-I.I 

HSCRtOGHS 

3.2.1.5.7.3-1.0 

on.  OSER  to  MNSCR 

3.2.1.5.7.3-l.P 

H5CR  to  DRRL  OSER 

3.2.1.5.7.3-l.Q 

NPSTOHSa 

3.2.1.5.7.3-l.i 

HSCR10NPS 

3.2.1.5.7.3-I.S 

MHIOHNSd 

3.2.1.5.7.3-l.T 

HSCRIDNH 

3.2.1.5.7.3-1.0 

HCtOHNSCR 

3.2.1.5.7.3-l.V 

HSCR  lOHC 

3.2.1.5.7.3-l.i 

ISSIC  TO  HSCR 

3.2.1.5.7.3-l.X 

HSCR10ISSPC 

3.2.1.5.7.3-l.t 

onSR  HSCR  TO  HSCR 

3.2.1.5.7.3-l.J 

HSCR  to  OIRER  HSCR 

3.2.1.5.7.3-l.U 

IRP10HMSCR 

3.2.1.5.7.3-l.AB 

MMSCRfOBV 

3.2.1.5.7.3-l.AC 

HSCRT01H 

3.2.1.5.7.3-l.AD 

MNSCR  TO  RCP 

3.2.1.5.7.3-l.AE 

MNSCR  TO  MNSCR  OPERATOR 

3.2.1.5.7.3-l.AF 

MNSCR  OPERATOR  TO  IBCR 

vninctnci  uvn. 


(1)  Input  fiw  Phast  1  MP  and  CFNiP  to  MSd  is  via  OBD  UBS  GS-200. 
Bad-stats  (Phais  2)  systav  not  sdwdalsd  otil  19K/W. 

(2)  laithor  tbs  MSC  nor  tba  MBCI  sill  ptovida  aiy  ootpst  to  tha  WP/OWP. 
Ill  WP/CFIMP  iapots  aza  via  satallita  fzoi  oaattaetor  Bob  facility. 


VOLUME  II  TEST  VESIFICATIOM  REQUIREMENTS  TRACEABILITY  MATRIX  -  TVRTM 


SECnOR  3 

m 

TOR 

nRENEiTS  PARAfiRAFR  REFEREICE 
IAS-SS-1000  VOL  II  (Sd-U) 

PARA  t 

TITLE 

mmonoR  lsvel  I  test  fui 


SITE 

LEVEL  I  L^VEL  |  LEVEL 


(3)  Tbe  RIP  project  is  on  hold. 

(4)  There  is  no  active  Iff  project  at  this  tiie. 

(5)  iNSCK  provides  ‘STATBS  ORLY  OR  REQOEST 

(6)  CISP  is  not  available 

(7)  GBD6  is  not  available 


NETBODS  A  T  >  Test  I  «  Inspection 

IffUNERATIOR  D  >  Oeionstration  A  <  Analysis 

X  >  Rot  Applicable 

IAS  QOAL  STATUS  Q  »  Deferred  (Does  not  exist  is  atrrat  IAS) 

P  «  Previously  q^ified  (will  not  be  redone) 
I  s  Eedeionstration  of  previous  qual 


VOLOHE  V  TEST  VERIFICATION  REQUIREMENTS  TRACEABILITY  MATRIX  -  TVRTM 


SBCnOR  3 

BBQOIlENmS  PmOUFB  lEPniKI 

PQR  US-SS-1000  POL  V  (SCM-12) 

TERinaTIOR  LEVEL 
AiDnnoo 

PAU  1 

TITLE 

SOBSTS 

LEVEL 

DRK 

LEVEL 

SITE 

LEVEL 

3.2.1.1.4.1.1 

S/S  suns/potponun  mmouK 

D 

D 

X 

3.2.1.1.4.1.2 

BEAL  Tin  NORITOUK 

D 

D 

X 

3.2.I.1.4.1.3 

LOCAL  UTA  FILE 

D 

D 

X 

3.2.1.1.4.I.4 

MTA  BEPOBT 

1 

X 

D 

3.2.1.1.4.1.5 

opEUTOK  suns 

D 

D 

X 

3.2.1.1.4.1.6 

S/S/  STATUS  BESPORSE 

D 

D 

X 

3.2.1.1.4.1.7 

S/S  Aim  CEnuTioi 

D 

D 

X 

3.2.1.1.4.1.9 

BEiuBi  n  nsoL  Alin 

D 

D 

X 

3.2.1.1.4.1.10 

s/s  ALEBT  dEniATIOi 

D 

D 

X 

3.2.1.1.4.1.U 

ALAn/ALEir  PABUETEBS 

D 

D 

X 

3.2.1.1.4.1.12 

Alin/ALEBI  DISABUK 

D 

D 

X 

3.2.1.1.4.1.13 

Alin/ALEKT  DISABLE  BEFOn 

D 

D 

X 

3.2.1.1.4.1.14 

CEBunaTioi  tbt  data 

D 

D 

X 

3.2.1.1.4.1.15 

OIAODSriC  TEST  UU 

D 

D 

X 

3.2.1.1.4.I.1I 

QPEBATIK  BOM  CUM 

D 

D 

X 

3.2.1.1.4.1.19 

PABANETEB  ADJDSnar 

D 

D 

X 

3.2.1.1.4.1.20 

BESET 

D 

D 

X 

3.2.1.1.4.1.21 

PAOLT  ISOUTIOi 

D 

D 

X 

3.2.1.1.4.1.31 

CEBTinaTIOR  TEST 

D 

D 

X 

3.2.1.1.4.2 

PEBTOBNAICE  (lABACIERISnCS 

L 

L 

L 

3.2.1.1.4.2.1 

ALAn/ALER  DBIBCnOi 

if 

T 

I 

3.2.1.1.4.2.2 

CIAKE  <»  STATE  ORECnOI 

AT 

T 

X 

3.2.1.1.4.2.3 

PEBIOBNAICE  UTA  BEFOR 

AT 

T 

X 

3.2.1.1.4.2.4 

OORIBOL  QORKAIDS 

AT 

T 

X 

3.2.1.1.4.2.5 

3.2.1.1.4.2.6 

OIHUD  AOniRLEIIGEnR 

NESSm  TBABFEB 

AT 

AT 

T 

T 

X 

X 

3.2.1.1.4.2.7 

QFSUTIKiaiB 

D 

D 

X 

3.2.1.1.4.2.8 

nSSACE  FUOUTT 

D 

D 

X 

3.2.1.1.6.3-l.a 

vsnnsa 

I 

D 

X 

3.2.1.1.6.3-i.ci  iNsci  n  m 

X 

0 

X 

lons:  (1)  wscR  providH  'siiiQs  (ht  OB  ngocsT 

(2)  TBi  fiRsa  hat  not  bM  tei^Htad  aa  a  oartifiabla  systai. 

(3)  suns  daU  only 


(4)  suns  OU  -  lo  coaandi  aooiptad 

(5)  suns  (ML!  -  Bo  ns  amapa  traasfv 

(6)  suns  (HI  •  lo  WaiataBaaca  Waintaaaca  BaqBaats  ar  Data 


NRBODS  (  T  >  fast  I  >  laapactioa 

nPiaraUTIOl  D  >  Baaonstratioa  i  ■  baalysia 
X  *  lot  Applicabla 


US  QQU.  suns  g  <  Oafarrad  (Doaa  aat  aiist  ia  conaat  US) 
P  «  PtaviooBly  qualifiad  (will  aot  ba  tadoaa) 
B  >  Badaaoastratioa  of  pttvioaa  goal 
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